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Abstract 

Increased uncertainty due to high penetration of renewables imposes significant costs to the system operators. The added 
costs depend on several factors including market design, performance of renewable generation forecasting and the specific 
dispatch procedure. Quantifying these costs has been limited to small sample Monte Carlo approaches applied specific dispatch 
algorithms. The computational complexity and accuracy of these approaches has limited the understanding of tradeoffs between 
different factors. In this work we consider a two-stage stochastic economic dispatch problem. Our goal is to provide an analytical 
quantification and an intuitive understanding of the effects of uncertainties and network congestion on the dispatch procedure 
and the optimal cost. We first consider an uncongested network and calculate the risk limiting dispatch. In addition, we derive 
the price of uncertainty, a number that characterizes the intrinsic impact of uncertainty on the integration cost of renewables. 
Then we extend the results to a network where one or more links can become congested. We show and calculate the existence 
of the price of uncertainty even in this case, under mild assumptions. We show that risk limiting dispatch is given by a set of 
deterministic equilibrium equations. The dispatch solution yields an important insight: congested links do not create isolated 
nodes, even in a two-node network. In fact, the network can support backflows in congested links, that are useful to reduce 
the uncertainty by averaging supply across the network. We demonstrate the performance of our approach in standard IEEE 
benchmark networks. 

I. Introduction 

The existing electric grid is operated so that online generation is sufficient to meet peak period demand. But uncertainties 
arising from outages and unpredicted fluctuations in demand and renewable generation can cause a loss of load event, 
when online generation does not meet demand some load needs to be disconnected from the power system. To decrease 
the loss of load probability, the system operator (SO) schedules generation and transmission line capacity so it exceeds 
forecasted peak net demand by a small percentage (around 5%), to compensate for small amount of uncertainty due to 
generator contingencies and load forecast errors. This additional reserve capacity is utilized in real time as actual loads and 
contingencies are revealed. Typically energy and reserve capacity are scheduled following a 'S-cr' rule: the total amount 
scheduled is the forecast plus '3-cr', where a is the standard deviation of net demand forecasting error. Currently, the typical 
values of cr is around 1% to 2% of total load. 
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Due to various incentives and state goals such as the renewable portfolio standards (RPS), renewables are expected to make 
up to 30% to 40% of generation mix in the USA. Increased penetration of renewable generation increases the uncertainty in 
the grid HI, ||2l. In such scenario, the current deterministic dispatch practice would require large reserve capacity allocations. 
Such allocations increase energy costs significantly and accrue unwanted emissions ||3|. For example, each additional 1% of 
reserve costs CAISO about 50 million dollars (based on 2009 costs). In light of the significant financial implications, various 
alternative forms of stochastic dispatch procedures have been studied ID, fS). The goal of these procedures is to solve a 
dispatch program that utilizes available forecasts and the sequential decision nature of the problem. Past approaches often 
resulted in programs that were infeasible in practice due to computational complexity and relying on Monte-Carlo type 
approaches that could only be calculated with a limited number of scenario samples. The complexity of these procedures 
makes it even difficult to reliably evaluate the benefit of smart grid technologies or improvements in forecasting. Moreover, 
these approaches require significant changes in the operating procedures and software of system operators. In some cases, 
the forecast error distributions are not utilized appropriately or at all IS). 

Recently, Risk Limiting Dispatch (RLD) Q, [SI was proposed as a new dispatch framework. By utilizing a simplified 
approach that is applied after unit commitment and does not consider network constraints, a very simple analytic dispatch 
rule can be obtained. The rule proposes an alternative deviation calculation that depends on error performance of forecasting, 
the costs of various generation alternatives and the timing of dispatch decisions stages. It was shown that in uncongested and 
lossless networks, the proposed dispatch significantly reduces the renewable integration cost. Moreover, reliable estimates 
of various metrics such as integration cost, emissions and costs due to forecasting performance can be easily obtained ||3|. 

The first contribution of this paper is the derivation of risk limiting dispatch for a congested network. This dispatch is 
denoted the network RLD and we show that it is simple to implement computationally(without the need for Monte Carlo 
type of simulations), results in reliable and interpretable dispatch decisions and can be used to provide stable performance 
estimation. We model economic dispatch under uncertainty as a two-stage dispatch problem where the decision is made for 
each operating hour Without loss of generality, we assume that the first stage occurs at the day ahead market and the second 
stage occurs at the real time market. In a day-ahead market (DAM), the SO purchases energy at generators connected to 
different buses in the network, utilizing forecasts and error distributions for loads and renewable generation at various buses. 
In the real-time market (RTM), dispatch decisions are made utilizing the realized values of all loads, renewable generations 
and physical network constraints such as transmission limits. We consider a DC power flow model for analysis and validate 
our results by considering full AC model in case studies. 

The key observation that makes the problem tractable is that in real networks, only a very small number of transmission 
lines are congested. For example, the commonly used IEEE benchmark networks H are far from being congested under 
normal operations. Also, the WECC model for the California network only include a few congested Unes ifTOl . We expect 
that the congestion patterns would not shift excessively under the uncertainty levels typically present in the renewable 
penetration levels expected in the near future. Intuitively, knowing the congestion patterns should reduce the complexity 
of the dispatch procedure since not all possible network constraints need to be considered. In this paper we formalize this 
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intuition by developing an accurate picture of a network operating under expected congestion, that is where congestion is 
predicted in the DAM, but is not deterministic. We observe a novel fact: a network operating under expected congestion 
due to uncertainty behaves qualitatively different than a network under deterministic loads and generation. We introduce 
the concept of back flow to capture this behavior Back flows are directed permissible flows in congested links that need 
to be included in a two stage dispatch. The possibility of back flow is somewhat surprising, as congestion in a two bus 
network in deterministic dispatch program implies the two buses are decoupled ifTTI . lfT2l . We also develop a computationally 
simple dispatch approach that utilizes this structural understanding to compute the dispatch in a simplified form via a set of 
equilibrium equations. The proposed approach can be easily integrated into existing unit commitment and dispatch procedures 
of the system operators. 

The first contribution of this paper is in developing the concept of price of uncertainty that characterize the intrinsic impact 
of uncertainty on the cost of dispatch. Given a network, the integration cost is defined as the difference between expected 
cost under the optimal dispatch procedure (i.e., RLD) and the dispatch cost if the SO has a clairvoyant view of all loads 
and renewable generations lITSl . We observe that under the expected mild to moderate uncertainty levels, the integration cost 
increases linearly with the uncertainty in the forecast error and the per unit of uncertainty cost of integration is the price of 
uncertainty. The price of uncertainty can also be interpreted as the benefit of improving forecast procedures and can be used 
as a metric to evaluate the benefits of forecasting and provide a reference point to judge specific dispatch methodologies. 

A brief discussion of related works follow. Monte Carlo based dispatch formulations that include security constraints and 
DC power flow balance have been studied recently lIU, lfT4l - lfT9l . They result in difficult optimization problems that can only 
be evaluated with (limited) Monte Carlo runs and do not provide much insight into the dispatch methods. MPC approaches 
II20I . II2TI address recourse in decision making, but still rely on Monte Carlo, and may not be appropriate when the number 
of recourse opportunities is small, Umiting the corrections calculated by MPC. Single market problems are more tractable 
II22I - II25I but do not capture the nature of recourse or congestion. Methodologies for assessing reserves in the presence of 
significant wind generation was presented in |[261 without including two stages or congestion. Current deterministic dispatch 
avoids complicated procedures by considering a worst-case net load to be satisfied, namely the forecast plus three standard 
deviations of forecast error ll2Tl . Other papers (e.g. [ESl . 1291 ) investigated a robust version of unit commitment utilizing a 
DC flow model without recourse to represent the market model, and 1301 used a similar model but is fully adaptive to the 
reahzation of the uncertainties. 

The remainder of the paper is organized as follows. Section |ll] sets up the two-stage dispatch model in detail, and describes 
the uncertainty model. Section |lll] reviews a single bus model and develops the price of uncertainty. In order to develop 
this qualitative understanding under limited congestion patterns we first study small network scenarios. Section |IV] first 
investigates a 2-bus network, defines the concept of back flow and identifies the appropriate structural results, utilizing it 
to develop a simple dispatch methodology. Section |IV] then investigates general networks with a single congested link and 
demonstrates an appropriate reduction mechanism. Section |V]provides computational experiments illustrating the performance 
of the procedure in real networks. Section |VT] concludes with future work. 
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II. Model Setup 

A. Network Risk Limiting Dispatch (N-RLD) 




Fig. 1. Power network example with five nodes. Demand at bus i is denoted by Di, the first stage generation by and second stage generation by g^. 
The capacity of line between bus i and bus k is denoted C'ik and the flows on each line is detemiined by the net injection, gi + g^ — Di at each bus. 

Network Risk Limiting Dispatch (N-RLD) is formulated as a two stage optimization problem in an power network 
(Figure [T]i- The first stage represents a market where the SO can buy energy corresponding to dispatch decisions. Decisions 
are made at each node of the network. The second stage corresponds to delivery or real time, which represents a 5 or 15 
minute interval during which energy is delivered. Stage 1 typically occurs 24 hours ahead of real-time and slow ramping 
generation or base load generation is dispatched at this stage lfT2l . In some cases, stage 1 can represent a market an hour 
ahead of real-time. Without loss of generality we call this stage 'day ahead'. Stage 2 is then the 'real-time'. 

The SO makes dispatch decisions constrained by an n-bus power network with transmission lines. The SO has to 
satisfy a random load li at each bus i, known only at real-time. He has available for free w, units of renewable energy, 
also revealed only at real-time. In stage 1, the SO can dispatch generation gi after observing information Y available about 
the random load and wind at all buses. In stage 2 or recourse stage, the SO chooses gf- after observing the random loads 
and demands to balance the network. The gf^'s can be seen as generation level of fast generators or shedded load. Energy 
can only be purchased in the first stage so > 0. Renewable generation is not dispatchable and is taken as negative load, 
following standard practice. The net load at bus i is defined as di = li — Wi and it can be positive or negative. Excess power 
at any bus i in the second stage can be disposed off for free, so gf^ can be positive or negative. 

The cost of dispatching generation at bus i in the first stage is Ci{gi) and qi{gf ) in the second stage. In general both 
costs are represented by increasing, convex functions. When not specified, we assume that both costs are linear and given by 
— and qi{gf ) — I3i{gf')^, where and pi are prices in dollars per MW and (x)+ = max(a;, 0). Later we show 
the assumption is not restrictive since while operating under mild to moderate uncertainty, we are interested in perturbations 
of the dispatch around its operating point, and it can be shown that the linear cost segment at that point determine costs. 
Moreover, to avoid trivial solutions and arbitrage, assume day ahead prices are smaller than real time prices, i.e., < f3k 
for all 1 < i, fc < n. The total SO cost for the first stage is the sum of first stage costs, and the total second stage cost is 
the sum of the second stage costs. 
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Once first stage dispatch decisions are made and renewable generation is realized, second stage dispatch decisions and 
power flows in the system are determined by the physical network and its properties. We consider a DC power flow model llSTI 
for dispatch calculation purposes. We validate the performance of the dispatch by considering the full AC model in the case 
studies. Dispatch decisions need to respect network flow constraints, and in particular transmission line constraints. The 
capacity of the line connecting nodes i and j in the network is given by Cij . We also utilize an observation about congested 
transmission links in practice. For example, in CAISO, normally only one or two of the main transmission lines from 
Northern California to Southern California experience congestion. This limited congestion assumption will be utilized to 
simplify the dispatch calculation. In particular in this paper we focus on the scenario with at most one congested link. In 
future work we generalize this to problems with k congestion link following the same approach proposed here. 

To establish the information structure of the two stage optimization problem, we propose the following forecasting model. 
The net load is decomposed as 

d = d + e, (1) 

where d = [did.2 ■ ■ ■dn]'^ is the first stage forecast and e = [eie2 ■ ■ ■Cn]'^ is a zero mean Gaussian distributed random 
vector with covariance matrix Se = ""e^e' where is a known error correlation matrix (e ~ A^(0, (TgEg)). Furthermore, 
the forecast d and error e are independent. Moreover, average performance of the forecast, in the form of forecast error 
variance (t^ is provided for each bus or operating region. 

The Gaussian error assumption is justified by recent studies (e.g. |(2l) that observe forecast errors are distributed as a 
(truncated) Gaussian random variable. For the typical variances utilized, the errors in utilizing a Gaussian distribution is 
negligible and an accepted practice in dispatch mechanisms. Also note that the results for Gaussian models carry over to 
many other distributions with little modification |8). 

B. Formulation and Decomposition of N-RLD 

We formulate the mathematical optimization problem in this section. Before stating the entire problem, it is convenient 
to define the following DC-OPF problem 

J(q,x)=minq^(g^)+ (2a) 

subject to - X - V'^f = 0, (2b) 

Xf = 0, (2c) 

|f I < c, (2d) 

where Eq. (|2b] l is the power balance constraint, S M"^™ is the mapping from branch flows to bus injections [!32l, f is 
the TO X 1 vector of branch flows, Eq. ( |2c] i is Kirchoff 's voltage law that states a weighted sum of flows in a cycle must 
be 0, Eq. ( l2db are the capacity constraints on the flows where c = [ci ... Cm\^ and {x)^ — max(0,a;). This optimization 
problem can be seen as a generic DC-OPF problem with prices q and demands x. Since only the positive part of generations 
is reflected in the cost, energy can be disposed for free. 
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N-RLD: The network risk limiting dispatch problem in can be stated as the following stochastic optimization problem: 

(i) Real Time OPF (RT-OPF): Solve the real time OFF problem J(/3, d — g) where J is defined in (|2]i. At real time, the 
day-ahead dispatch decisions g are already made, and the realization of the random variables are known. Therefore the 
new net demand is d — g, and J(/3, d — g) balances the network under the real time prices /3. 

(ii) Day Ahead Stochastic Power Flow (DA-SPF): 

y*(d) =min|a^g + E[J(/3,d-g)|d]|, (3) 

g>0 L J 

where the expectation is taken with respect to the distribution of d conditional on the forecast d. The constraint g > 
limits the day ahead decisions to purchasing generation power only. Additionally, g is function of the forecast d and 
the error distribution. The optimal solution to (|3) is called the risk limiting dispatch. 

C. Integration Cost and Price of Uncertainty 

A fundamental quantity of interest is the impact of uncertainty in the cost of dispatch. We call this quantity if integration 
cost [Sl, which is defined the difference between the expected cost of the procedure and the expected cost of a dispatch 
clairvoyant of the realization of d. The clairvoyant dispatch can allocate all the required power in the day ahead by solving 
the deterministic OPF (d) = J{a, d). The integration cost for a realization of the information set d is given by 

Ci{d) = V*{d)-E[VS{d + e)\d]. (4) 

An important question is regarding the sensitivity of this cost to the forecast error standard deviation ae when the best 
possible dispatch is utilized. If C/ is a linear function of (Te, so C/ = pa^, then p is the price of uncertainty, a fundamental 
limit faced by any dispatch procedure. In this paper we show the existence of this price, and determine it for various 
scenarios. 

D. Small-a Assumption 

An important consideration is the order of magnitude of the error standard deviation compared to the entries in the 
average net load vector ji and the transmission line capacities. Standard deviation of day ahead load forecasts are 

1% 2% of the expected load /i^- Wind error forecasts are more severe, and error standard deviations aw of 30% of 

rated capacity have been observed. High wind penetration scenarios have about 30% of total load being generated by 
wind, and therefore the total error would be about 0.01 + 0.3 * 0.3 ~ 10% of total load. 

In contrast to the financial situation, a relative forecast error of 10% would not change the overall physical operating 
characteristic of the network. More precisely, suppose we calculate the deterministic dispatch based on the forecast values 
d and find bus i would be generating power in the first stage. Then with high probability, bus i would still be generating 
power in the two stage dispatch problem. Also, the network congestion pattern under the deterministic dispatch and the 
two-stage dispatch should not be drastically different. Sections Hill and HVl formalizes these observations. 
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We denote above scenarios small-a scenarios. In theoretic arguments this usually implies studying scaling regimes such 
that the variance of the prediction error a ^ 0. For simplicity of exposition, we avoid such limits in the relevant points 
in the analysis, but the formal arguments follow easily from the stated theorem. The important observation is that forecast 
values are very useful in determining the qualitative behaviour of the network. 

III. Uncongested Network 

This section reviews the risk limiting dispatch control for a two stage uncongested network fS), ll33l , and analyzes the 
price of uncertainty in this scenario. 

A. Risk Limiting Dispatch 

Since we only consider a single bus, all variables are scalar. Equivalently, the single bus network can be thought as an 
n-bus network without congestion. In this case, the constraint region in ^ reduces to net supply must equal net demand, 
and the RT-OPF becomes 

J*{l3,d-g)^ mm P{g^)+ 

s.t. .g^ + .9 - (i = 

= {d-g) + . 

The DA-SPF in Eq. ^ can then be reduced to 

g* = argminag + /?E[((f — (5a) 
s.t. g > 0. (5b) 
RLD can then be derived as follows. Consider the unconstrained optimization problem 

mm ag + I3¥\{d- g)+\d]. (6) 

9 

Taking the subgradient with respect to g gives the optimality condition 

= a-/3E[l(rf-5 > 0)|d] 
= a-/?E[l(rf + e-.g > 0)|d] 
==a-;3Pr(e> g-d\d), 

rearranging gives 

Pr(e>5-d|d) = 0(5-rf) = ^, (7) 



the optimal control g is given by inverting (|7|l 
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Note it is possible that g < 0, it can be shown that the risk limiting dispatch g* (optimal solution to the constrained problem 
in Q) is given by thresholding 

g* =g+ = [d + Q-\^)] + . (9) 

B. Price of Uncertainty 

Since most power systems would not have 100% penetration in the near future, we assume that the net demand d, and 
its prediction d, are positive. Then first we would show the price of uncertainty exists (i.e. the integration cost is linear in 
(Te), and then calculate its value. 

Theorem 1. Suppose d > 0. Then C(d) defined in (|4|i is linear and can be written as 

C{d) = a,p, (10) 

where is the standard deviation of the error e and p = l3(j){Q^^ {^)) ((/>{■) is the standard Gaussian density and Q{-) 
is the complimentary Gaussian cumulative density function). 

Theorem [U relies on the observation that if net demand is positive {d > 0), then it is always beneficial to purchase energy 
in the day ahead as the energy price is higher in real-time, so the optimal schedule must be positive g* > 0. The positivity 
constraint in the simplified DA-SPF (Eq. (|5]l) is redundant, and the cost of uncertainty (Eq. (|4|i) can be computed as 



C{d)^V*{d)-Vcid) (11a) 

= min ag + (3E[{d ~ g)+\d] ~ aE[d+\d] (lib) 
g 

= min ag + /3E[{d - g)+\d] - aE[d\d] (11c) 
a 

= min ag + /3E[(d + e - g)+\d] - aE[d\d] (lid) 
a 

= min a{d + A) + PE[{e- A)+\d]- aE[d + e\d] (lie) 

= mm aA + /3E[{e- A)+\d] (llf) 

= ae{unn aA' + l3E[{z - A')+\d]} (llg) 

= (JeP, (llh) 



where (a) follows from the assumption d > 0, (5) follows from setting 5 = (i + A, (c) follows from changes from variables 
where A' = A/fTg and z = e/de- P only depends on the standardized random variable z with unit variance and thus is 
independent of the forecast error standard deviation a^- 

The structure of the optimal control was not used in the previous derivation, so the existence of the price of uncertainty 
p was demonstrated without calculating its value, which can be numerically calculated in close form as below. Using the 
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same technique as solving ^ the optimal A' in ( llgi is given by Q ^{^)- The price of uncertainty p becomes 



p = a(^'i(5) + /?E[(z-Q-i(^))+] 



aQ-\^) + P {z- 



■'(f)). 



(12a) 
(12b) 

(12c) 
(12d) 



Figure 12] plots the price of uncertainty for different values of a//3 with f3 set to be 1. Somewhat surprisingly, p is not 
monotonic in a//3 and it goes to as a//3 approaches or a//3 approaches 1. Intuitively, when a//3 is small, the day ahead 
cost is very low, and the SO can purchase sufficient amounts of energy to absorb the prediction error In contrast, when 
a//3 is close to 1, the day ahead and real-time costs are similar, so the SO waits until real-time to balance the system once 
the net load realization is completely known. 




Fig. 2. The price of uncertainty for different ratios of a/fl. 



C. Extremely High Penetration 

In some networks renewable power may have a penetration level of more than 100%, violating the small-cr assumption. 
For example, in a microgrid where wind or solar energy is abundant, the net demand could become negative. In this case, 
the cost of uncertainty is no longer linear in the standard deviation of the prediction error and in general cannot be computed 
in closed form. Figure |3] plots the cost of uncertainty of a system where d = — 1 per unit, and a/ p = 1/3. The cost of 
uncertainty is low when cTg is small since no additional energy is needed to balance the system, and as Ce increases, the 
cost becomes linear with the slope (/)(Q~^(l/3)). 

IV. Congested Networks 

The RT-OPF in N-RLD for n-bus networks does not admit an analytical solution as in the single bus case, significantly 
increasing the complexity of the full dispatch. In particular, it is difficult to obtain the day ahead dispatch g in closed form. 
Moreover, the cost of uncertainty can be a complicated function of the information set Y and the network capacities c. 
These quantities can be numerically computed resorting to a Monte Carlo approach, but the computational challenges are 
formidable due to the high dimensionality of the problem. 
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Fig. 3. The cost of uncertainty for a/l3=l/Z, d = —1. 

Instead, the small-cr assumption from Sec. can be explored to obtain a simple and interpretable dispatch. Since the 
prediction error is a small percentage of the net load, the change in flows caused by that error is also a small percentage, we 
assume the prediction error is small compared to both d and c. Under the small-cr assumption, the qualitative or structural 
behavior of the power system predicted in the day-ahead from the forecast d will not differ from its realization in real-time 
after observing d. If we expect to purchase power at a bus in the day-ahead, then after real-time, we do not expect power 
to be shed in that bus. If a transmission line is expected to be congested in a certain direction in the day-ahead, then 
the direction of congestion would not be reversed at real time. Since qualitative features are consistent with the forecast, 
a deterministic OPF based on the day-ahead price a and the net load forecast d will predict congested lines, congestion 
directions and buses where energy is purchased correctly. This deterministic OPF is denominated Nominal Day-Ahead OPF 
(NDA-OPF); 

J(Q:,d) = minQ;"'"(g)~'" (13a) 
g 

subject to g - d e T'. (13b) 

In stochastic control terms, NDA-OPF solves the certainty equivalent control problem for N-RLD Q ll34l , ||35l , by replacing 
the random quantity d by the deterministic quantity d and solving the optimization problem. Denote the generation schedule 
from NDA-OPF by g . 

The day ahead schedule g in the DA-SPF (Eq. ([3]i) can be decomposed as the nominal dispatch added to a perturbation 
g = (5 + A)+ where A e M" is the perturbation. The optimal schedule is determined by computing A. Perturbations 
are expected to be small since the uncertainty is small, so the perturbed DA-SPF can be significantly simplified. The 
simplification relies on three key observations for small-cj forecast error: 

1) If < 0, bus i is treated as a source of unlimited energy, since it is shedding energy in the nominal problem 
(NDA-OPF). If > 0, then the perturbed dispatch Ai is not constrained to be positive. 

2) If the line between buses i and k are not congested, then it is not congested in perturbed DA-SPF. 

3) If the line between buses i and k is congested from i to fc, then it would not become congested from fc to i in the 
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perturbed DA-SPF. 

Going forward, we assume these observations to hold. This is called the small-cr assumption. We propose the two step 
algorithm in Algorithm 1. 

Algorithm 1: Procedure to solve Network Risk Limiting Dispatch 

Step 1 (NDA-OPF): Solve the nominal problem in Eq. (fTsl i using forecast net load and day ahead prices to obtain the 
nominal schedule g and nominal line flows f . 

Step 2 (Perturbed DA-SPF):Solve the DA-SPF (Eq. (O) for the optimal perturbation A by substituting g = g + deA* 
and appropriately normalizing and reducing the problem using Observations (1) — (3) as 

A* =axgmina^A + E[J(/3,e)|d] (14a) 

A 

subject to A, = if < 0, (14b) 

A,>Oifg, = 0, (14c) 

where 

J(/3,e)=min/3^(y)+ (15a) 

s.t. y - e - V'^f = (15b) 

Kf = (15c) 

/,fc<0if7,, = c.fc, (15d) 

and /?,; = Pi if > and Pi = otherwise. The optimal DA-SPF dispatch is then given by g = (g + o'eA)+. 

At first glance, (fl4] i seems to be no simpler than the original problem in (O. However, note that the network capacity 
constraints ( I15db only include the lines that are congested in the nominal problem. In essence, (fT4l i balances a 'left-over' 
network from solving the nominal problem, and (I15dt states that if a line is congested in the nominal problem, no more 
energy is allowed to flow along the direction of congestion. 

The next subsection explores the normaUzation and reduction process to define the Perturbed DA-SPF for two bus and 
three bus networks. We show the perturbation A is the solution to a set of deterministic equilibrium equations. Then the 
problem of an arbitrary network with n buses and a single congestion link is studied and we show the general reduction 
procedure results in an optimal dispatch control under the small-cr assumption. 

A. Two Bus Network 

Consider the two bus network in Fig. |4] For this network, the day ahead dispatch is a vector g = [gi 32]^ of the scheduled 
generation at each bus. The real-time balancing of the network requires solving an OPE where the injection region is two 
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di 



c 



I 

^2 



Fig. 4. A two-bus network where c is tlie capacity of the line. 



dimensional. The RT-OPF becomes 



R\ + 



J{f3,d^g)=mmf3' (g«) 



subject to gf^ + gi 

92 

I/I <c, 



9^ 



di-f 
d2 + f 



(16a) 

(16b) 
(16c) 
(16d) 



where / is the amount of power flowing from bus 1 to bus 2 and c is the capacity on the line. 

To apply Algorithm 1, first solve the NDA-OPF (Eq. [T3T l for the two bus network. Then, to apply Step 2, we partition 
into the five regions in Fig. [5] according to the value of the net demand forecast d. Each region is defined by whether 
the transmission link is congested or not, the direction of congestion, and whether each bus is scheduled to generate power 
in the nominal problem. The small-cr assumption enables inference of these facts with high probability from the solution of 
flie NDA-OPF 



A 
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B 




D 

C 



di 



Fig. 5. Partition of R with respect d when ai <ol2. The small-cr assumption means that the actual realization of d is in the same region as d w.h.p. 



Regions A, B, C and D are reduces to the single bus case as analyzed in Section |lll] In regions B and D, since the line 
capacity is not binding, power can flow from one bus to the other without congestion. In region A, bus 1 has excess power 
and transfer up to capacity to bus 2, and then reserve is only needed for bus 2. Region C is symmetrical to region A. 

For region E in Fig. |5] di > — c and dz > c. Since buying at bus 1 is cheaper (ai < 02), the SO should transfer up to 
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line capacity c units of energy from bus 1 to bus 2. The NDA-OPF solution is then 

_ di + c 
g = , 

At first glance, it seems the two buses are now decoupled and can be treated as two isolated buses since the line between 
them is congested. However, this viewpoint is not correct due to the two-stage nature of the problem and congestion being 
directional. In the two stage dispatch problem, the SO decides in the first stage to purchase some energy based on the 
forecast and error statistics; however the actual balancing of the network occurs at the second stage. Some averaging of the 
errors can still occur even if the line from bus 1 to bus 2 is congested. For example, suppose that in real-time ei > and 
62 < 0. That is, demand at bus 2 was over-predicted and demand at bus 1 was under-predicted. Due to this configuration, 
bus 2 needs less than c units of energy from bus 1, and the remaining energy can be utilized to satisfy the under-predicted 
demand in bus 1. This represents a flow from bus 2 to 1 and does not violate congestion constraints, since the line was 
congested from bus 1 to 2. Due to this property of opposing the congestion direction, we denominate this flow a backflow. 
For example, backflow does not arise in region A because bus 1 always has an excess of energy and does not require any 
energy from bus 2. Similarly for region C. 

In region E, the small-cr assumption implies that d e with high probability and the line is not congested from bus 2 
to bus 1 (Observation (3)). Assuming that errors ei and 62 have covariance matrix 



J2^l J2 



(17) 



711 P 
p 722 

the optimal dispatch and price of uncertainty in region E are given by: 
Theorem 2. Under the small-a assumption, the risk limiting dispatch is given by 

g* = g + CTeA*, 

where g = [di + c (i2 — c]^ and A* is the unique solution to 

tti = miii(/3i, /32) Pr(2;i > Ai, zi + Z2 > Ai + A2) 

a2 = Pr(z2 > A2) 

+ min(;3i,/32)Pr(z2 < A2,zi + Z2 > Ai + A2), 
where z ~ [zi z-i}^ = e/de. The cost of uncertainty is linear and the price of uncertainty is given by 

+ min(/3i,/32){E[(zi + Z2 - A^ - A*)+l(z2 < A^)] 

+ E[(zi - Ai)+i{z2 > a;)]} + E[(z2 - a;)+]. 

Before formally proving Theorem |2] we provide an intuitive explanation of the non-linear equations in ( fTSl l. After 
subtracting the nominal dispatch choice, the net demands (normalized by Ce) are zi and Z2 respectively, and only backflow 



(18a) 



(18b) 



(19) 
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is allowed. The network reduces to a two bus network with a unidirectional link going from bus 2 to bus 1 (Fig.|6]l. The left 



'r 

Zl Z2 
Fig. 6. The perturbed network consisting of a unidirectional link and normalized demands zi = ei/a"e, Z2 = 62/0-2 . 



hand side of ( fTSl ) can be seen as the cost of purchasing an additional unit of energy at the buses in stage 1, while the right 
hand side can be seen as the benefit of having that unit of energy at stage 2. Therefore (fTFt can be interpreted as balancing 
the cost and benefit between buying an additional of unit at stage 1 . For example, one additional unit of energy at bus 1 is 
useful if two event occurs: zi > Ai (bus 1 does not have enough energy) and (b) zi + 2:2 > Ai + A2 (bus 2 does not have 
enough energy to transfer to bus 1). Since power can be transferred from bus 2 to bus 1 in the perturbed network (Fig. 0, 
the price of buying an unit of energy at real time is min(/3i, /32) and the right hand side of ( |18at is the expected benefit of 
having that unit of energy available. The price of purchasing that unit of energy at stage 1 is ai. At optimaUty, equiUbrium 
is achieved between the cost at stage 1 and the expected benefit at stage 2. Similarly, jlSbl l describes the equilibrium at bus 
2 

Figure |7] plots the ratio in the average price between a network where backflow is not taken into account and a network 
that allows backflow as a function of the correlation between errors ei and 62- If backflow is not allowed, then the network 




Fig. 7. Ratio in prices between using and not using back flow for ai = 02 = 0.5 and /3i = /32 = 1- Note the curve is always below one since a 
network with back flow can do no worse than a network without backflow. 



becomes two isolated buses. The ratio is always less than 1 since a network with backflow can do no worse than a 
network without backflow. The ratio is highest when the two buses are negatively correlated since backflow averages out 
the uncertainties in the error As the two buses become positively correlated, backflow becomes less useful since both errors 
tend to be the same sign and averaging is less useful. 

Proof of Theorem |2} Any dispatch can be written as g + a^A.. We first prove the optimal A is independent of cTp. 
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Substituting g = g + fTg A, the DA-SPF (Eqn. ([3]i)becomes 

minimize Q;^(g + (Je A) + E[J(/3, d - (g + (TeA))|d] (20a) 

subject to g + (Te A > 0. (20b) 

By the small-cr assumption, the constraint in Eqn. ( I20bb is always satisfied since g > from the definition of NDA-OPF. 
The RT-OPF (Eqn. (O) becomes 

J(/3,d-(g + aeA)) (21a) 

=minimize /3^(g^+i)+ (21b) 

subject to +^ + 5i + cTeAi - / - rfi - ei = (21c) 

92^^ +92+ -^e A2 + / - rf2 - 62 = (21d) 

-c<f<c. (21e) 

Since the nominal flow is c, let / = c — (5 with S representing the backflow. Substituting the value of g into Eqn. fTH . 

J{f3,d-{-g + a,A)) (22a) 

=minimize /3^(g^+i)+ (22b) 

subject to .gf +^ + (leAi + S - ei = (22c) 

g^+^ + ffeAa -3-62^0 (22d) 

< (5 < 2c. (22e) 

By the assumption that the line does not congest from bus 2 to bus 1, the constraint S < 2c is always satisfied and can be 
dropped. Normalizing Eqn. (l22T i by de gives 

J(/3,d-(g + aeA)) (23a) 

=creminimize /3^(g^+^)+ (23b) 

subject to .gf +^ + Aj + (5 - zi = (23c) 

+1 + A2 - (5 - Z2 = (23d) 

5 > 0, (23e) 

where the optimization variables g^+i and 6 have been normalized by tJe and := eijue- Let J = J/ce, and note that J 
only depdent of /3 and A. Combining (|20] | and (l23T l, A solves the unconstrained optimization problem 

min a^A + £;[J(/3, A)]. (24) 
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To solve this optimization problem, we need the gradient of E[J{f3, A)] with respect to A. The optimization problem can 
be analytically solved to yield 

min(/3i + I32)izi + Z2 - Ai - A2) 

if zi + > Ai + A2, Z2 < A2 
min(/3i + /32)(2:i - Ai) + ^2(^2 - A2) 
Jil3,^) = { if zi > Ai,Z2 > A2 

/32(^2- A2) 

if zi < Ai,Z2 > A2 
otherwise 

= min(^i,/32)[(zi + Z2 - Ai - A2)+l(z2 < A2) 

+ (Zi - Ai)+l(z2 > A2)] + /32(Z2 - A2)+. 

Using the linearity of expectation and taking derivatives with respect to A in A + E[J{(3, A)] gives ( fTSl ). 

Next we prove the price of uncertainty is given by Eqn. ([19). The value of full knowledge optimization problem is 
E[J(Q;,d)]. The error is zero mean and by the small-cr assumption, E[J(Q;,d)] = a^g where p is the nominal solution. 
The cost of uncertainty is 

u^a'^{g + CTe A) + E[J{f3, d - (g + (Je A))] - E[J(a, d)] 
= cre(a^A + E[J(/3, A)] 



B. N-bus Network with a Single Congested Line 




Fig. 8. A zonal map of the California transmission network under CAISO control. The subnetwork within a zone are uncongested under nonnal operation. 
The tie lines to other WECC areas are not shown. 
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Most networks consists of a large number of buses and lines, but under normal operating conditions, only very few lines 
are congested. For example, the California transmission network can be thought as divided into three zones connected by 
major transmission lines shown in Figure |8]and the flows within a zone are unrestricted ll36l . The zonal grouping in CAISO 
was designed utilizing the idea of collapsing together buses connected by uncongested transmission lines in a deterministic 
OPF. We formalize and extend this intuitive concept for ND-RLD by showing that a general network with a single congested 
link reduces to a two bus problem under mild to moderate uncertainty. More concretely, assume the line from bus 1 to bus 
2 is congested, then 

Theorem 3. Under the small-a assumption, suppose that = Ci2 is the only congestion in the network, then the following 
holds: 

1) There are at most two nodes with positive generation. That is, 'g.^ > Q for at most two i. Furthermore, ifgi < 0, then 
only one other bus has positive generation. 

2) The optimal control takes the form 

g* = (g + A)+, 

where 7^ only if'g^ > 0. 

3) If pi = (3k = P for all i, k, then the network can be thought as a congested two node network with congestion from bus 
1' to 2' with correlated errors. Let k ^ 1 be the bus with positive generation. Then the first stage costs are a'l ~ ai 
and a'2 = — 7fcCn) and the errors are given by 

n n 

61=61+^7^6,; 62 = 62 + ^(1 - 7i)ei, (25) 
where 7^ G [0, 1] are determined by the topology of the network. 

Point 1) in Theorem |3] seems strange since it is highly unlikely that only two generators would be generating in a power 
network. This result is comes from the assumption that the prices are linear in the power generated, which is used here 
to simplify the presentation. In practice, cost functions are piecewise linear or quadratic. If piecewise linear cost functions 
are used, then Theorem |3] 1) is modified to stating that there are at most two generators operating at their marginal cost 
lfT2l : if quadratic (or other continuous increasing) cost functions are used. Theorem |3] is modified to stating that there are at 
most two different marginal costs among the generators. The details of the derivation is given in the Appendix. The overall 
message of Theorem |3] remains unchanged in each case: in a network with two congested link, the risk limiting dispatch 
can be calculated by considering a two-bus network obtained from the original n-bus network. 

The proof of this theorem is somewhat technical and is given in the appendix. The theorem states that the network can be 
collapsed into a single bus or a two bus network, utilizing an appropriate averaging of the net demands. To understand how 
to calculate the bus averaging weights 7^, it is convenient to simplify (|3]l (with cost /3) by considehng fundamental flows 
II37I . By theorems in graph theory, Eq. (l2ci can be eliminated by choosing a spanning tree in the network, and identifying 
the branch flows on the tree as fundamental flows f . All flows f are determined by these n — 1 fundamental flows denoted 
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f e M" ^. Let R be the mapping from f to f (f = Rf). Let A = V^R. The constraint ( |2c] i can be eliminated and dD 
reduces to: 



J*(/3,x) =min/3^(g^)+ 

subject to - X - Af = 
IRf I < c. 



(26a) 
(26b) 
(26c) 



Let af be the ith row of A for i = 1, . . . ,n. For each node i = 3, . . . , n in the network, let f be set of fundamental 
flows that solve the following set of equations 



A'^ = 
af f(^) = -1 

a^fW =0, k^i,k>3. 



(27a) 
(27b) 
(27c) 



In matrix form, f solves 



fW = Af« =-e,_i, 



100 ••• 

A2 

where A2 is the (n — 2) x (n — 1) matrix obtained by removing the first two rows of A. Inverting gives n'^ = — A^^e^-i 
and 

7. = aff«. (28) 

Next we apply Theorem |3] to a three bus single cycle network with equal admittance on each line. Let the prediction d 
be such that the line from bus 1 to bus 2 is congested. That is, = cu in the nominal problem. There are four possible 
congestion pattern J3 as listed in Figure |9] Bus i is labeled by the sign of 5^. Figure [TO] shows the equivalent two bus networks 





1 *3 1 

(a) (b) 
Fig. 9. Possible sign patterns of g when a single line is congested. 



3 1 T 
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(c) 



0.2 



3 1 




(d) 



for each of the networks in Fig. |9] after applying Theorem |3] The networks in Fig. [TO] are labeled by the first stage costs, 
the sign patterns and the forecasted errors at each of the nodes. Let A' be the solution to the two bus networks in Fig. [TO] 
Then the controls A for the original problem are given in each of the networks in Fig. [TOl 



Other patterns are possible, but occur for a set of d that is of measure zero 
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T T I^T T 1' 

ei + 563 62 + 563 ei + 563 62 + \e§i + 563 62 + 563 ei + 563 62 + 563 

(a) A3 = (b) A2 = Ai, (c) Ai = A'l, A2 = Ai, (d) Ai = A'j - Ai,, A3 = 

2A'2 

Fig. 10. The equivalent perturbed networks for the networks in Fig. |9] respectively. The left bus is 1' and the right bus is 2'. The back flow is only 
allowed form 2' to 1'. 



V. Simulation Results 

This section explores various numerical examples using the IEEE 9-bus benchmark network. In particular we compare 
the performance of ND-RLD with utilizing the standard 3 — ct rule. We also compute the price of uncertainty numerically 
and compare it to the theoretical prediction. 

A. Uncongested Network 

Many practical networks have line capacities that are much larger than the typical power flows. For these networks, they 
are well approximated by a single bus network. For example, consider the IEEE 9-bus network in Figure [TT] The nominal 



Fig. 11. IEEE 9-bus benchmark network. Bus 1,2,3 are generators and the rest of the buses are loads. 

generation and demands from the data included with this benchmark network ||9], ll38l is shown in Table HI] Note that line 
flows are significantly smaller than transmission line capacities. Therefore, under moderately high penetration, the network 
can be thought as a network operating without capacity constraints. 

Up to this point we have used the DC power flow model, while in reality power flow is AC. It is known that for 
transmission networks, due to the low R/X ratios of the transmission lines, DC and AC power flows yields similar answers. 
This is confirmed in our simulations where the difference in performance of using the risk limiting dispatch under DC and 
AC power flow models is minimal. Therefore it is sufficient to use the simpler DC flow model to obtain the dispatch. 

To analyze the performance of the risk limiting dispatch derived in Section |III1 we compare it to two other dispatches. 
The first one is the currently used 3 — cr dispatch, and the second one is the oracle dispatch where the actual realization of 
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DC How 
AC Flow 



134.4 
134.3 



94.1 
94.2 



TABLE I 

All units are MW. Negative numbers are the demands at buses 5, 7, and 9. The generations needed at buses 1, 2, and 3 to meet 
these demands under both dc flow and ac flow are shown. note that due to losses, the total amount of generations needed 

under the ac power flow model is slightly higher. 



From bun 


1 


4 


5 


3 


6 


7 


8 


8 


9 


To bus 


4 


5 


6 


6 


7 


8 




9 


4 


DC Flow 


86.6 


33.7 


-56.3 


94.1 


37.8 


-62.2 


- 134.4 


72.2 


-52.8 


AC Flow 


89.8 


35.2 


-55.0 


94.2 


38.2 


-61.9 


-134.3 


72.11 


-54.3 


Capacity 


250 


250 


150 


300 


150 


250 


250 


250 


250 



TABLE II 

All units are MW. Both DC and AC power flows on each line of the network is shown. Capacities are the long term emergency 

RATING OF THE LINE. THE NETWORK IS UNCONGESTED SINCE AT MOST A FLOW TAKES ABOUT HALF OF THE CAPACITIES ON THE LINE. 



the wind is known at stage 1 . We assume that all the generating buses have a first stage cosj^ a = 1 and all buses have the 
same second stage cost /3. For simplicity, the prediction errors are generated as i.i.d. zero mean Gaussian random variables 
with variance cr^. The predictions d is taken to the nominal demands in Tab. U 

The risk limiting dispatch is derived by viewing the network as a single bus. For actual operation, the amount of reserves 
to put at each buses in the network need to be determined. Here we spread the reserves equally among the three generating 
buses(buses 1,2 and 3). From ^ and the fact that the prediction errors are independent, the single bus risk limiting dispatch 
is Yll=i di + ^ where A = V^crQ^^ij)- The network risk limiting dispatch is given by 

1 T 



grid 
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.6 134.4 94.1 















_3 3 3 

The 3 — (T control purchases a reserve of 3 times the standard deviation for each bus in the network, or 3 • 9 cr. Again we 
spread out the 3 — cr dispatch over the three generating nodes as 



?rld 



86.6 134.4 94.1 







9aO-i(-) 



1110 







We simulate the cost for both the DC and AC power flows. 

Figure [T2] plots the total cost of the three dispatches for /3 = 1.5a. As we can see the risk limiting dispatch performs 
much better than the 3 — ct dispatch. There are two reasons why the 3 — ct dispatch or rules like it perform badly. The first 



^The nominal generations are determined by an OPF problem, and every generator with non-zero generation has the same marginal cost. This can be 
thought as a. 
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is that the 3 — u rules is too conservative since it does not take into account the actual cost of the second stage; the second 
reason is that the 3 — a dispatch ignores the potential benefit of averaging between the prediction errors by treating the 
different buses as isolated nodes. In contrast, risk limiting dispatch takes these two points into consideration. Figure [13] is 

4000 r , , 




°0 20 40 60 80 100 120 

Sigma 



Fig. 12. Total costs for /3 = 1.5a as a function of a. The red, blue and black lines are the total cost for the 3 — cr, risk limiting, and the oracle dispatches 
respectively. The solid lines are the costs under DC flow while the dotted lines are for AC flows. 



a zoomed in version of Fig. [12] by plotting the total cost only for the risk limiting dispatch and the oracle dispatch. The 
cost for the oracle dispatch is constant at 315 up until a = 80. This is expected since the predicted total demand is 315 
MW, and the prediction errors are zero mean, so the errors averages out. At higher a, the capacities in the network become 
binding and the cost goes up since not all errors can be averaged. The cost for the risk limiting dispatch is essentially linear 
for all (t's. a lower bound for the minimum total cost is the total cost of applying the risk limiting dispatch to a network 
with infinite capacities, since an infinite capacity network has lower cost than a finite capacity one and the risk limiting 
dispatch is optimal for the former From Figure [T3] this lower bound is almost met. Thus the risk limiting dispatch is close 
to optimal and our assumption of viewing an uncongested network as a single bus network is valid. The slopes of the lines 




Fig. 13. Total costs for 13 = 1. Set as a function of a. The blue and black lines are the total cost for the risk limiting and the oracle dispatches respectively. 
The purple line is the cost of the RLD when applied to an infinite capacity network, which is a lower bound for the minimum cost of the finite capacity 
network. The slopes of the blue and the purple lines represent the price of uncertainties. 



gives the price of uncertainties. As expected, the price of uncertainty for the oracle dispatch is since the actual realization 
is known at the first stage. The price of uncertainty of the risk limiting dispatch closely matches that of the single bus price 
of uncertainty, while the 3 — (t price is much higher 
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B. Congested Network 

To construct a congested network, the network in Fig. [TT]is modified by increasing the nominal load at bus 5 to 150 MW 
and reducing the capacity of the line connecting bus 5 and 6 to 75 MW. Then the line from bus 6 to bus 5 is congested. There 
are two different first stage costs ai and a2 and these are given by the marginal costs of the generators. Let a ~ ^{o-i +0-2) 
and we normalize all cost by a. Figure [14] plots the total cost of the three dispatches for /3 = 1.5q!. Again, we see the risk 
limiting dispatch performs much better than the 3 — (t dispatch. Figure [15] is a zoomed in version of Fig. [14] with the total 
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Fig. 14. Total costs for = 1.5a as a function of a. The red, blue and black lines are the total cost for the 3 — cr, risk limiting, and the oracle dispatches 
respectively. The solid lines are the costs under DC flow while the dotted lines are for AC flows. The purple line is the cost of the rid when applied to a 
network where only one line has finite capacity, namely the line congested under the nominal flows. This is a lower bound for the minimum cost of the 
finite capacity network. The slopes of the blue and the purple lines represent the price of uncertainties. 

cost only for the risk limiting dispatch and the oracle dispatch. As expected, the cost of the oracle dispatch is constant over 
a wide range of cr's. The cost of the risk limiting dispatch is linear and very close to its lower bound. The lower bound is 
obtained by applying the risk limiting dispatch to a network with only one finite capacity line, namely the line congested 
under the nominal flows. Figure [15] shows that the abstraction of thinking about a network with one congested line as a two 
bus network is very accurate. 
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Fig. 15. Total costs for f} = 1.5a as a function of cr. The blue and black lines are the total cost for the risk limiting and the oracle dispatches respectively. 
The purple line is the cost of the RLD when applied to a network where only one line has finite capacity, namely the fine congested under the nominal 
flows. This is a lower bound for the minimum cost of the finite capacity network. The slopes of the blue and the purple lines represent the price of 
uncertainties. 
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Figure [16] shows the difference in cost of using the risk limiting dispatch derived in Section [III] and using the risk limiting 
dispatch developed in this section. As expected, the later dispatch performs better since it takes into account the congestion 
in the network. The gap in cost should increase as the ratio ^ increases. 



900 
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Fig. 16. Total costs for /3 = l.Sa as a function of a. The blue line is the total cost for the risk limiting dispatch developed in Section ITvl The red line 
is the total cost if the lisk limiting dispatch derived for the congested network in Section IlIII is used. 



VI. Conclusion 

In this paper we addressed the solution of a two-stage stochastic dispatch for system operators. We showed that a simple 
closed form control exists under mild to moderate uncertainty about future realizations of net demand. The control is 
composed of two parts, one which is the certainty equivalent control rule, and another that is a deviation that hedges against 
the uncertainty by appropriately taking into account costs and recourse opportunities. Moreover, by incorporating the fact 
that only a finite number of transmission lines that congest at any given hour The price of uncertainty is a tool to measure 
the performance of distinct dispatch procedures. We show that under mild assumptions on forecast errors, the proposed 
dispatch achieves the cost bound given by the price of uncertainty. The proposed procedure also performs rather well in 
a full AC network. In future and ongoing work we will address unit commitment combined with the stochastic dispatch 
procedure and the generalization of the proposed method to multiple stages. 
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Appendix 

A. Proof of Theorem \3\ 

By assumption only the flow from 1 to 2 is congested, (|26] | can be replaced by an equivalent problem by choosing /12 
as a fundamental flow and including only the constraint on it. Without loss of generality, let /i = /12. 

J*(/3, d - g) = min/3^(g^)+ (29a) 
subject to - (d - g) - Af = (29b) 
A < C12. (29c) 



Writing (|29] l as a linear program gives 

minimize a^y (30a) 
subject to y - Af - d > (30b) 
/i < C12 (30c) 
y > 0. (30d) 

The Lagrangian is 

£ = a^y - A^(y - Af - d) + - C12) - v^y, 
where A, /i, and v are the Lagrangian multipliers. Differentiating with respect to y gives 

a - A - 1/ = 0. 

Since v are the Lagrangian multipliers associated with the constraint y > 0, but complementary slackness yi > only if 
I'i — OT Xi — ai. Equivalently, 5^ > only if i^i = or = a^. Differentiating with respect to f gives 

A^A + ^ei=0, (31) 

where ei = [1 • • • 0]-^ is the first standard basis. The dual is 

maximize A^^d — /iCi2 (32a) 

subject to < A < a (32b) 

A^A + /iGi = (32c) 

H>0. (32d) 

At first glance it seems that the dimension of ( |32] | is n+1. However since (l3Tl i is n — 1 equations involving n + 1 unknowns, 
there are in fact only 2 independent variables. The next claim gives a precise characterization of the solution of (3% . 
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Claim 4. The solutions to ( 1321 ) are in the forms of 





1 














1 


x = 


73 


Ai + 


1-73 




In 




1 - 7« 



where 7,; G [0, 1] for z = 3, . . . , n and 

H = k{\2 - Ai), 
where k is a positive constant depending on the graph structure. 

Suppose the claim is true. The first statement of Theorem |3] is that only two nodes are generating energy. From 
complementary slackness, > only if A; = a^. Since a. has only two degrees of freedom, for generic a, = 
for at most two components. Therefore in general only two nodes would be generating energy. 

The second statement is that only the nodes that generates power would be used to do the perturbation control. That is, 
A; 7^ only if 5,^ > 0. The intuition is as follows; suppose < 0, then under the small sigma assumption, can be viewed 
as an infinite source of free energy, so no perturbation is needed; suppose 5, = 0, if a small unit of energy is purchased at 
node i, there is a cheaper option to purchase the unit of energy somewhere else (or 'g^ would have been positive), therefore 
A, = 0. 

To show that the problem reduces to a two bus network if all /3 are equal, we need to consider the second stage 
optimization problem. Now let f denote the set of perturbed flows. Since the line from 1 to 2 is congested in the nominal 
problem, /i = /12 < 0. Let Xi = A,; + {—'gij^/cr — Zi, where A^ is the first stage control, (— is the left over energy, 
and Zi is the normalized estimation error The second stage optimization problem becomes 

J{l3,'g) = minimize /3^y (33a) 

subject to y - Af + X > (33b) 

/i < (33c) 

y > 0. (33d) 
This optimization problem has precisely the same form as (l30b . with C12 = 0. By Claim |4l the dual of ( l33T l is 

maximize — Ai7^x — A2(l — 7)"^x (34a) 

subject to < 7A1 + (1 - 7)A2 < f3 (34b) 

A2 - Ai > 0, (34c) 
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where 7 = [1 73 • • • ^nV , o,i <= [0, 1] and depends on the network topology for i = 3, . . . , n. If /3's are all the same (or 
/3i, P2 are smaller than all other /?'s), then the dual reduces to 

maximize — Xix'i — \2x'2 (35a) 

subject to < Ai < /3i (35b) 

< A2 < /32 (35c) 

A2 - Ai > 0, (35d) 

where x'l = j'^x and = (1 ^ 7)"^^- This is exactly the dual of a two bus network with prediction errors 7^z and 
(1 — 7)"^z, leftover energy 7"^(— g)^ and (1 — 7)"^(— g)^, and controls 7-^A and (1 — 7-^)A. 

Let A'j^ = 7^A and = (1 — 7)^A. It can be shown that if there are two generating nodes then one of them can be 
taken to be node 1. Suppose the other generating node is node k. To solve equilibrium equation (fTsT l for Aj and Aj, the 
associated first stage costs are ai and — JkC^i) respectively. 



28 



B. Proof of Claitn^ 

We prove Claim |4] be guessing the solution and verifying it is correct. We show A = [1 73 
by ( |28]) solves (l3l1 i. Expanding A^A gives 

n 

A^A = a,7i 

2=1 

n 

= ai + ^ a.ij, 

1=3 
n 

= ai + ^a,(an«) 

n 

= ai + 5:a,((fWfai) 

n 

= ai + ^ai((-A-ie,_i)^ai) 



y„]-^ where 7^ is given 



1=3 



ai-(A^(-A-ie,_if)ai 
(I-(A^(-A-ie,_if))ai 



(a) 



(I- 



% ^ ^ . . . 

1 ••■ 

1 

••■ 



)ai 





where * denote a generic number and (a) follows from observing that (A~^ei_i)^ is the transpose of (A^)~^ without the 
first row and the following simple lemma 



Lemma 5. Let X^earxr— 1 matrix and suppose the matrix 
obtained from Y by removing the first row. Then 



ei X 



is invertible with inverse Y. Let Yi be the matrix 



XYi 



* * * • • • * 

1 ••• 

1 ••• 

: 

••• 1 
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We still need to show that 1 > O^i > 0. This can be done through graph theory, but it is simpler to recognize that the 
flows given by dZTl ) solves a DC OPF problem. For the i'th node, the optimization problem is to find the least generation 
need at nodes 1 and 2, satisfying a demand of 1 unit at node i, demand at all other nodes, and no flow on the line between 
1 and 2. Therefore ji is the proportion of power that node 1 produced, and 1 — ji is the proportion of power that node 2 
produced. 

The vector [0 1 1 — 73 • • • 1 — 7,1] is a solution to dSTI ) since 1 is in the null space of A-^. 

C. Nonlinear Prices 

First consider the following nominal OPF problem where q's are differentiable 

n 

minimize ^94(5,^) (36a) 

i=l 

subject to g - Af - d 0, (36b) 
where qi{-) is increasing and convex, f are the fundamental flows and the line capacities are infinite. Rewriting ( |36] | as 

n 

minimize qtiy) (37a) 



subject to y - Af - d > (37b) 
y > 0. (37c) 



The Lagrangian of dJTl l is 



^ = E'^'(y)-^^(y-Af-d>o)-z/V (38) 

i=l 

At optimal, the primal and dual variables minimizes the Lagrangian, so 
and 

A^A* = 0. 

The null space of A^ is spanned by the 1 vector, therefore A* = A*l for some A*. By complementary slackness, node 
i is generating if i/j = 0. The nodes in the network can be divided into two groups, one group is all the generating 
node and the other is the non-generating nodes. For all the generating nodes, the marginal prices are all the same, that is, 
QiiUi) — I'kiVk) ~ if J/i > and yk > 0. From the perturbation control of view, the network consists of many nodes 
with the same first stage cost A*, therefore the perturbation control A can be divided up in arbitrary fashion between those 
nodes. 
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Now suppose that the network has one congested link. The nominal problem becomes 

n 

minimize ^^(7i(y) (39a) 

1=1 

subject to y - Af - d > (39b) 

h < Ci2 (39c) 

y > 0. (39d) 



The Lagrangian is 



At optimal, 



and 



C = Y, Q^y) - ^^(y - Af - d > 0) + fiih - C12) - i^^y. 



A^A* + /_i*ei = 0. 

From previous results, A can be decomposed as A = aAi + (1 — a) A2, where ai = 1, 02 = and ai E [0, 1] for i ~ 3, . . . ,n. 
The decision variable in the two stage optimization problem becomes A[ — A and ~ (1 — a)^ A, and the optimization 
problem is 

min AtA', + A;a; +E[J(/3, A' A')]. 
A'j.A^ - - 

After solving for the optimal A[ and Aj, we need to map it back to the original A^'s. Again, if i/i = 0, then we set A^ = 0. 
For the rest of the nodes, A[ and A2 can be split up in any fashion as long as it is consistent. 

D. Piecewise Linear Cost Functions 

In practice piecewise linear cost functions (convex, increasing) are often used. We start again with the uncongested 
network. Since the cost functions are not differentiable, the Lagrangian in d38T l is not differentiable. We use subgradients 
instead. Given a function /(x) : M" — > R, a vector s e M" is a subgradient of / at x if /(y) — /(x) > s-'"(y — x) for all 
y. The set of all subgradients at x is called the subdifferential and denoted 9/(x). By the convexity, at optimality, 

for some s* G dqi[y*) and 

A^A* = 0. 

We still have all A's are equal and the two stage problem only depends A = Ai + A2 + • • • + A„. In contrast to the 
differentiable cost case, here the control is only done at one node, that is, A = A^ for some node i and A^ = if fc 7^ i. 
The reason is that all generating node except one would be operating at a corner point on their respective cost curves and 
it is optimal not to change those comer points. Only one generator would be operating at a point not at the comer, and 
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(a) Comer Operating Point (b) Non-comer Operating Point 

Fig. 17. All generating node except one will be operating at a comer point. 

all the control should be done at that point. Similarly, for a network with one congested link, only two generators will be 
operating at a non-corner point, and the perturbation control is done at those two points. 
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